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Audio i^ttodiicdoa apparatus, feedback system and me^ 

30. 1^ 




V 



The invention relates to an audio reproduction apparatus comprising: 
input means for inputting an input audio signal; 

an output for outputting an output audio signal derived from the iiqjut audio 

signal; 

5 . a cost ii^ut for inputting a mathematical cost derived from a measurement, 

which measurement is user-influenceable; and 

a conditioning unit, capable of delivering the output audio signal in 
dependence of the mathematical cost 

The invention also relates to an audio feedback system comprising: 

10 - an audio source; 

a measurement device arranged to deliver a measurement which is user- 

influenceable; 

a mathematical cost calculation unit, arranged to derive a mathematical cost 

from the measurement; 
15 - a sound production device; and 

a conditioning unit arranged to receive an input audio signal from the audio 
source, to receive the mathematical cost, and to deliver to the sound production device an 
output audio signal derived from the input audio signal, in dependence of the mathematical 

20 The invention also relates to a method of deriving an output audio signal from 

an iqput audio signal ia dependence of a mathematical cost derived &om a measurement 
which is user-influenceable. 

The invention also relate to a computer program for execution by a processor, 

describing above mentioned method. 
25 The invention also relates to a data carrier storing Ae coniputer program. 

An embodiment of such an audio reproduction apparatus is known from US- 
A-4,788,983. The known apparatus is designed for use by a person performing a sports 
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activity, who wants to listen to music. The known s^aratus contains a conditioning unit 
enable of transmittmg an iiq>ut audio signal &om a walkman as an output audio signal to 
headphones. The conditioning unit also receives a mathematical cost signal &om a heart rate 
measurement device. A user specifies according to e.g. his age or sex a safe window of heart 
5 rate which he wants to use during his trainmg. If his heart rate is too low, he is clearly not 
getting enou^ ex^cise. On the other hand, if his heart rate is too high, his exercise might be 
unhealthy. The conditioning imit transmits the input audio signal only if the measured heart . 
rate is within the desired window, and otherwise no sound is sent to the headphones. 

It is a disadvantage of the known apparatus that such a crude regulation of the 
10 output audio signal is not user fiiendly. B.g. if the vtdndow is narrow, it is difficult for a user 
to judge whether he has lost his music because he is running too slow or too fast 



It is an object of the invention to provide an audio reproduction i^aratus of 

1 5 the kind described in the opening paragraph, which is relatively versatile as far as the 
regulation of the output signal is concerned. 

The object is realized in that the conditioning unit comprises an audio 
processing means arranged to process the input audio signal to derive the output audio signal 
with a reproduction quality in dependence of the mathematical cost. The conditioning tuiit of 

20 the known audio reproduction apparatus contains elements which only implement a switch 
Amotion. In case the heart rate is outside the window, no signal is sent to the headphones. 
This is not very desirable. If the user is training just a littie too soft, he will hear absolutely no 
sound. Rafher than to be motivating to start running harder again, this can be very 
demotivating for certain users. It is desirable that there is a gradual change, so that the user 

25 can underachieve during a certain period and still have music. Furthermore heart rate 

measurements are not always reliable, 6.g. if a signal of a nearby second user is picked up. 
The user is then punished for something out of his control. The audio reproduction apparatus 
according to the present invention is arranged to off^ the user many more versatile strategies 
of responding to his sports activity, embodied as strategies of calculating the mathematical 

30 cost. Hie ^paratus according to the invention is also arranged to provide more versatile 

output audio presentation strategies. Instead of just switching off the output audio signal, the 
apparatus of the invention offers options of changing the reproduction quality of the output 
audio signal. This is a physical measurable and determinable correlate to the perceptible 
psycho-acoustical quality of the sound. E.g., the audio reproduction apparatus may be able to 
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gradually lower the sound amplitude, leading to less intelligible music. Alternatively, if 
stereo is present an underachieving user can be punished in that the audio reproduction 
apparatus delivers mono instead of stereo, in which case Uie number of independent oulput 
signals is a reproduction quality measure of the perceived psycho-acoustical quality. 

In an embodiment, the reproduction quality comprises a three-dimensional 
position of a virtual sound source, the audio processing means being able to simulate the 
virtual sound source by means of the output audio signal. Of the set of aU audio-processing 
functions which can be q>pUed to obtain some psycho-acoustical quality, some realize the 
audio positioning of a virtual sound source in three-dimensional space around the head of a 
user. This is especially mteresting for the user traveling a distance -real or virtual- such as a 
jogger or somebody on a bicycle hometrainer. If he instructs the ^aratus that he should run 
at a certain speed, he should be at a certain position -real or virtual- at a certain time. The 
audio reproduction apparatus can position the vhtual sound source by sending an ^propriate 
audio signal to a left and a right loudspeaker of the hea^hones, the virtual sound source 
being e.g. two virtual loudspeakers at a distance of 1 meters in ftont of the user. If the user 
runs too slow the virtual loudspeakers move away firam him, and this can be simulated if 
desired by making the sound emerging from the virtual loudspeakers become ever less 
audible. The user can catch up with the loudspeakers by running faster. By adding synthetic 
reverberations other three-dimensional audio position quality measurements can be 
influenced, such as the illusion of a waU in front of the user. 

In a modification of flie embodiment, the audio processing means comprise a 
filter arranged to simulate the position of virtual sound source by deriving the output audio 
sigtial by filtering the input audio signal with a user dependent head related transfer fimction 
(HRIIO.-Byjneans.of.an.HRTEA.sojtind .SO.»rc^ such as ayirtual IqudspeakCT can be_ _ 
accurately positioned. The input audio signal for the left resp. the right headphone 
loudspeaker is filtered by a respective HRTF, simulating the path through a virtual room of 
sound from an actual loudspeaker at a p<5sition in the room to the respective ear of the user. 

In another modification of the embodunent or a further variation on the 
foregoing modification, the audio processing means comprise an audio processing unit 
arranged to sfanulate the position of the virtual sound source by changing a property of the 
output audio signal selected &om signal amplitude and added reverberation. Both properties 
are simple signal processing functions to reaUze the illusion of sound with a specific fhree- 
dimensional audio position quality. 
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The audio processing means can also be arranged to derive a second output 
audio signal, together with the output audio signal constituting a stereo audio signal, the 
audio processing means being arranged to derive the stereo audio signal fix)m the input audio 
signal with a specified stereo quality dependent on the mathematical cost. Signal processing 
5 functions influencing the stereo quality are e.g. the following: 

the virtual loudspeakers are moved closer to each other if the user 
underachieves; 

the audio signals for tiie left and right virtual loudspeakers are made more 
similar if the user underachieves; or 

10 - one ofthe virtual loudspeakers dissqppearsifthe user underachieves. 

The last option can also be implemented as a -gradual or brusque- switch 
between multichannel surround such as Dolby S.l and 2 chaimel stereo. Varying Ihe stereo 
quality is advantageous given the widespread presence of stereo sound. 

It is advantageous if the reproduction quality comprises a specification of the 

IS distribution of fiequencies of the output audio signal. By changing the firequency content of 
the output audio signal, the audio processing means can simulate other efiects. E.g. an 
underachiever is punished by removing the bass of the audio signal. The three-dimensional 
position of a virtual soxmd source can be influenced by such an audio processing function too. 
E.g. the audio processing means may be arranged to remove high firequencies as if the sound 

20 has to travel a long way through a thick fog, or resides at a depth in a virtual wall. 

It is also advantageous if the audio reproduction apparatus comprises a first 
quality calculation unit for determining the reproduction quality fox use in the subsequent 
derivation of the output audio signal by the audio processing means. The reproduction quality 
is a ixroperty of the output audio signal. The audio reproduction ^paratus could measure it on 

25 the output audio signal, but then the input audio signal first has to be processed by an a priori 
unknown processing algorithm. A correlate reproduction quality can be determined by the 
first quality calculation unit and send to the audio processing means which applies a 
corresponding processing function. B.g. changing the angle of two virtual loudspeakos has 
an influence on the stereo quality, and it is in general not necessary to specify what num^cal 

30 stereo quality a user experiences. If more accuracy is desired, a specific angle function can be 
stored in a memory, e.g. based upon user panel tests. It is also possible that the user specifies 
a relation between e.g. his running speed and the angle himself, or chooses between a number 
of prestored functions, some of which change the angle slowly and other quickly. 
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Alternatively or additionally it is advantageous if the audio reproduction 
apparatus comprises quality measuring means for measuring an output quality' measure of the 
output audio signal, and comprises parameter value calculation means for calculating a 
parameter value, for use in the subsequent derivation of the ou^ut audio signal by the audio 
5 processing means. If tiie quality of the output signal is measured, it can be fed back for 
changing the processing on the input audio signal for future times. Such a feedback control 
loop obtains the desired reproduction quality after some tuning time. The parameter value 
calculation means can take an incompatibility between the result of the reproduction quality 
measuietnent and the desired quality measurement into account. The parameter value is 
1 0 changed accordingly, steering the processing ftmction until it obtains the deshred audio output 
signal reproduction quality* 

In another embodiment a mathematical cost calculation unit is comprised 
which is arranged to derive the mathematical cost fix>m the measurement receivable fiom a 
measurement device* A mathematical cost can be derived from any kind of sqpparatus, e.g. a 
I 1 5 random generator if the audio reproduction i^aratus is used in a conoqpetitive game. 

Typically the mathematical cost may be determined on the basis of a measurement which the 
iiser can influence, such as his running speed, heart rate, etc. A measurement device could 
send the mathematical cost directly to the apparatus, e.g. as a coded number. Typically 
however the audio reproduction apparatus may contain the new fimctionality, so that it can be 
I 20 used with an off-the-shelf measurement device. 

I In a modification of the previous embodiment, the mafliematical cost 

I 

calculation unit is arranged to derive the mathematical cost based on a difference between the 
measurement and a chosen value. E.g., the user sets this chosen value being his desired 
rummg speed.as. lOkin/h, .orJhis desiredJheart rate.as JSJOJjp^ ih^.e..g.. _.. . 

25 detennined as the actual runiiing speed minus 10 km/h.1^ 

rq>roduction quality changes. Or in an alternative version, if he runs a little harder nothing 

happens, and if he runs a lot harder the audio processing means are arranged so that the 

r^roduction quality starts changing gradually depending on the amount of time he is running 
harder than tfa6 chosen value. 

30 In an alternative modification of the previous embodiment or in addition to the 

previous modification, the mathematical cost calculation unit is arranged to derive the 
mathematical cost from abiometric measurement Engineering quality audio systems and 
biometric measurements are totally unrelated fields of technology. Apparentiy, nobody sees a 
need of combining them. Biometric measurement systeros are usually designed by engineers 
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who WMk in close coqperatiaii with physicians, and priorities in this field are exactness and 
robnstaess of the measurements and safety. The quality of audio reproduction is more an 
artistic matter of taste. This has led to the feet fliat biometric measurements are usually 
displayed on numeric displays. An exception is the beeps of a medical monitor, but the audio 
5 fimctionafity of such monitors is designed for simplicity rather than artistic reproduction 
quality. There is a need for user-fiiendly feedback of biometric data while training, since a 
user does not like to watch a display continuously while training. Sound however wbsa 
present automatically enters the user's ear. 

The audio feedback system is charactaized in that the conditionmg unit 
10 comprises an audio processing means arranged to process the input audio signal for the 
d^vation of the ou^ut audio signal with a reproduction quality in depoidence of the 
mathematical cost It is advantageous to produce the system as a whole since then all 
components can be realized as being optimally tuned to each other. 

The method of deriving an output audio signal &om the input audio signal in 
15 dependence of the mathonatical cost derived Scorn a measurement which is nser- 
influenceable is characterized in that flxe output signal is derived with a ^ecified 
rqproduction quality dependent on the mattiematical cost. 



20 These and other aspects of the audio reproduction j^aratus, the metitod, tlie 

audio feedback system, the computer program and the data carrier according to the invention 
will be ^parent fitom and eluddated with reference to the implementations and embodiments 
described hereinafter, and with reference to the accompanying drawings, which save merely 
as non limiting illustrations. 
25 In the drawings : 

Fig. 1 schematically shows an application of the audio reproduction q>paratus; 
Fig. 2 schematically shows an embodiment of the audio reproduction 

apparatus; 

Fig. 3 schematically shows an onbodiment of the audio processing means of 
30 the audio reproduction apparatus; 

Fig. 4 schanatically shows an embodiment of the audio feedback system; 

Fig. 5 schematically shows an embodiment of the data carrier; 

Fig. 6a and b sdiematically show a respective example of a mathematical cost 

function; 



PHNL021457EPP 



7 20.12^002 
Fig. 7 schematically shows an exan^le specification of a position quality as a 

function of mathematical cost; and 

Fig. 8 schematically shows an example of a frequency spectum of an output 

audio signal output by the audio reproduction apparatus. 

In these Figures elements drawn dashed are virtual in Fig. 1 , and c^tional in 

the other Figures, depending on the desired embodiment. Not all elements present in the 

illushative embodiment of the audio processing means in Fig. 3 need be present in an 

alternative embodiment 

Fig. 1 shows a usa: 100 of the audio reproduction s^aratus 200 according to 
the invention, who is jogging. He could e.g. also be rowing on an indoors rowing machine. 
While doing his sports activity he is listening to music coming as an ou^ut audio signal o- 
see Fig. 2- from the audio reproduction apparatus 200, being e.g. a portable audio player sudi 
as an MPS player, and reproduced by the left and right headphone loudq)eaker 114 and 115 
of a sound production device 102, typically being headphones. The reproduction quaHtyR of 
the music is changed by the audio reproduction apparatus 200 in dependence of the sports 
performance of tiie user 100, e.g. varying between Dolby 5.1 and mono without bass 
frequencies. E.g. if he runs too slow, he is penalized with music of bad reproduction quality 
R. His performance can be measured by at least one of various sensors. E.g. a pace meter 108 
connected to his sports shoe or another measurement device like a heart rate meter 106 
delivers a measurement signal m. For the heart rate meter 106 this measurement can be e.g. a 
PQRST comgplex of an electrocardiogram, a time sequence of pulses, or a number 
-representing the heaLrate. The audio jgpro^ 
m to a reproduction quality R. 

In a simple variant of the audio reproduction apparatus 200, tiie audio 
reproduction strategy is fixed, and the user 100 can only specify the way in which the 
measurement is transformed into a mathematical cost c. Note that far clarity reasons the 
examples are described fi>r an embodim^t in which all the mathematical transformations are 
realized as software algorithms running on a processor, but dedicated hardware circuitry 
could also be used. E.g. the user 100 can specify an interval iv in which his heart rate should 
lie such as [LL, LU] in Fig. 6a. A mafliematical cost ftmction 602 is shown in a coordinate 
system 600 wifli on the x-axis the heart rate measurement m minus a chosen value d and on 
the y-axia the mathmatical cost c. This chosen value d is set by the user as the target heart 
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rate for his training, e.g, 180 bpm. The interval [LL, LU] can be symmetrical or asymmetrical 
around the chosen value d The mathematical cost function can be fixed in the hardware of 
the audio reproduction apparatus 200 of Fig. 2, or the user can specify by means of user 
interface means 311 of Fig. 3 how the mathematical cost changes with m-d. E.g. as in Fig. 6a 
5 up to the marker values ML and MU the mathematical cost changes linearly with a small 
slope, while between the marker values and the limits of the interval iv die mathematical cost 
slopes more steeply, and outside the interval iv the mathematical cost increases very steeply. 
In an alternative mathematical cost function 606 specification shown in Fig. 6b, the 
mathematical cost is non-zero and linearly changing only outside the training interval iv. E.g. 

10 in Fig. 6b the user 100 has designed a cost function with negative values if he is running too 
slow. A negative cost can then during reproduction easily be noiapped e.g. as a negative angle 
a of a virtual sound source, and a positive cost corresponding to speeds which are too high as 
a positive angle a. In this way both cases can be easily discriminated. The user has freedom 
in designing the cost function by choosing e.g. training interval limits, quickness of change of 

15 the cost -which can be translated into quickness of change of audio reproduction quality R-, 
whether only measurements below the chosen value d are leading to nonzero cost, etc. 

The user interface means 31 1 are e.g. software running on a processor, which 
requests the user to type numerical values of marker values and slopes, or which allows the 
user to draw the mathematical cost function 602 graphically. The fixed axidio reproduction 

20 strategy is e.g. the one illustrated in Fig. 7. Here the reproduction quality R is embodied as 
what is called in the rest of the text a position reproduction quality P, which is any 
specification of a physical parameter of the output audio signal o resulting in the perception 
that the output audio signal comes fi'om a position of a virtual soxmd source. E.g. the virtual 
sound source can be perceived close to a user's head or far away, or in Fig. 7 it is an angle a 

25 of a virtual sound source around a user's head. If the user 100 is running with the desired 
target speed, the mathematical cost c is zero and the angle a is also zero degrees, i.e. the 
virtual sound source is right in front of the user 100. If the runner runs too slow or fast, the 
mathematical cost c with a specification like in Fig. 6b decreases resp. increases, and the 
virtual sound source shifts to the left resp. right side of tiie user 100. The sound source can 

30 stay behind the user xmtil the user 100 runs with the desired speed of the chosen value d again 
or runs with the desired speed again for a certain amount of time. Alternatively, the sound 
source can also start behind the user 100, being an annoying motivation to run harder. 

In more advanced variants of the audio reproduction apparatus 200, tiie user 
100 can also specify the strategy for changiug the reproduction quality as a function of the 
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mathematical cost c. He can program a first quality calculation tmit 330 in Fig. 3 which 
outputs e.g. as a stereo quality S an angle 1 60 between a first virtual sound source 1 52 and a 
second virtual sound source 154 generated by liie output audio signal o and a second output 
audio signal o2, as a linear function of flie mathematical cost c. Or he can select an 
5 alternative or additional audio processing fimotion, which e.g. adds an amount of 

reverberation as a function of the mathematical cost c to simulate a distance of a virtual 
loudspeaker in a virtual room. 

Another example application of the audio reproduction apparatus 200 is the 
prevention of repetitive strain injury (RSI) or inactivity. In this case user 100 sits e.g. in firont 
10 of apersonal coniputer (PC) or on a couch in firont of a television (TV). The sound 

production device 102 is e.g. a loud^eaker connected to the PC or television. The chosen 
value d is the amount of time the user 1 00 wants to work or wateh TV befiare taking a break. 
The mathematical cost c is e.g. determined by the amount of time t elapsed since a startmg 
tune to ininus the chosen value d, being the aUowable time to work or watch TV 

15 continuously: 

c=^(t-'to)-d ift-to >d; 
c = 0 \ft-to<d [1] 
With two loudspeakers of a TV or PC, a virtual sound source position can be 

simulated. 

20 Fig. 2 schematically shows an embodiment of the audio reproduction 

s^aratus 200 in its basic form. An input audio signal i comes in via an input means 204 firom 
. e.g. a portable MPS player or the sound card of a PC . The iapat audio signal i can come form 
outside or inside the audio rqproduction apparatus 200. In the latter case the audio 

25 source 201 . The iiiput audio signal i can be mono or multichannel audio. There is also a cost 
input 208 for receiving a mathematical cost c fix>m a mathematical cost calculation unit 21 0, 
which is arranged to derive the mathematical cost firom a measurement made by a 
measurement device 212. The mathematical cost calculation imit 210 can be incorporated in 
the audio reproduction apparatus 200 or can be separate, e.g. in the measurement device 212. 

30 The measurement device 212 is typically not incorporated in the audio reproduction 
apparatus 200, although it could be, in case it is e.g. a clock. The audio reproduction 
apparatus 200 contains a conditioning unit 202, which contains an audio processing means 
216 arranged to process the input audio signal i to derive the output audio signal o with a 
reproduction quality R in dependence of the mathematical cost c. The output audio signal o 
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goes to an output 206, to which a loudspeaker 214 caa be connected. The audio processing 
means 216 can just perform a single parametric fiinction leading to an output audio signal o 
of variable reproduction quality and hence perceptible psycho-acoustical quality, or multiple 
audio processing algorithms can be applied alternatively or simultaneously as in Fig. 3. 
5 Fig. 3 schematically shows an audio processing means 316, being an 

embodiment of the audio processing means 216 of the audio reproduction ^paratus 200. In 
the audio processing means 316 a number of processing units are shown purely for 
e}q>laining various features of the audio reproduction apparatus 200, and it should be clear 
that other combinations are possible. The audio processing means 316 is arranged to suj^ly 

10 an output audio signal o to a first loudspeaker 314 and if required a second output audio 
signal o2 to a second loudspeaker 315. 

For many audio processing algorithms, the rqaoduction quality R can be set in 
advance, and a subsequent audio processing is chosen depending on the reproduction quality 
R. E.g. the reproduction quality R can be a parameter of an audio processing algorithm, as in 

15 the case where flie amplitude of the output audio signal is set This can be realized with a 

variable gain amplifier. In other cases, user panel tests or the preferences offbs actual user of 
the audio reproduction apparatus 200 can be used to select an appropriate processing 
algorifibm, e.g. the first, second or third processing algorithm, 320, 322 resp. 324. In the 
example embodiment of Fig. 3, a third mathematical cost c3 from a second measurement 

20 device 352 goes to an algorithm selector 326, which e.g. contains a table of intervals. If the 
third mathematical cost c3 falls within a first interval, the first processing algorithm 320 is 
selected, etc. Such a configuration makes it possible to switch to entirely different algorithms 
dependent on the value of the third mafhanatical cost c3. E.g., the first algorittmi may change 
the angle 160 between two virtual loudspeakras, depending on wha» in the first interval the 

25 third mathranatical cost c3 fells. If the third mathematical cost c3 becomes so hi^ that it fells 
outside the first interval and in a second interval, the second processing algorithm 322 is 
selected, which e.g. changes the amplitude of flie signals fi»m the virtual loudspeakeacs, or 
both the angile 160 between them and the signal amplitudes. Another example in which the 
reproduction quaUty R is set prior to the processing is the setting of an angular position on a 

30 sphere around the user's 100 head of a virtual sound source by means of a head related 

transfer function HRTF. E.g., when the user 100 wears headphones, the input audio signal i 
can be simulated to come firom a virtual sound source position, by filtering it by means of 
filtCT 332 using a specific first HRTF to obtain tiie output audio signal o for the left 
heac^hone loudspeaker 1 14 and using a specific second HRTF to obtain the second output 
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audio signal o2 for flie right heac^hone loudspeaker 115. Both HRTFs are dependent on the 
required position of the virtual sound source- e.g. specified as two angles on a unit sphere- 
and can be fetched from a memory 334 containing HRTFs for a number of different 
positions. A first quaHty calculation unit 330 deteraiines the reproduction quality R needed 

5 for further audio processing. E.g. in the above described case Ihe first quaHty calculation unit 
330 calculates an angle a of the virtual sound source, used for fetching the HRTFs, as a 
linear function of a first maliiematical cost cl. The first mathematical cost cl is derived from 
ameasurement device 312 by amathematical cost calculation unit 310, which e.g. evaluates 
a function like fee one in Fig. 6a. Details on measuring HRTFs can be found in patent WO 

10 01/49066 and paper 'T.L. Wightman and D J. Kistler Headphone simulation of firee field 
listening, t Stimulus synthesis. Journal of the Acoustical Soc. of America 85 np. 2, Fd).. 

1989, pp. 858-867.". 

In other cases, the reproduction quality R has to be measured on the ouQ)ut 
audio signal o itself, e.g. because the relation between the reproduction quaUty R of the 
15 output audio signal o and the particular processing is too conq)lex to formulate or unknown. 
In this case feedback can be used to select the right processing algorithm or the right 
parameter for a parametric processing algorithm. QuaUty measuring means 344 measure an 
ou^ut quaUty measure M of the output audio signal o. The output quaUty measure M and a 
desired reproduction quaUty R from a second quaUty calculation unit 340 are fed to a 
20 parameter value calculation means 346. From these two parameters, a parameter value pv is 
calculated for steering subsequent processing by an audio processing unit, which selects a 
particular processmg algorithm or changes aparameter of a parametric algorithm. This can be 
done by any technique known from control theory. E.g. An update parameter value pv can be 
calculated as in equation [2]: 
25 pv=-S{M-R) [2] 

Actually parameter value pv can be any fimction of M and R, if necessary also 
taking into account that the output quaUty measure M is a different fimction of the deshed 
psycho-acoustical quaUty than the reproduction quaUty R. 

The required unpUcit functionality between the output quaUty measure M and 
30 the reproduction quaUty R derived from the first mathematical cost cl, can be specified by 
user 100. With user input means 360, e.g. a key board, a touch sensitive panel, or a turning 
knob and user mterface means 311, the user 100 can specify anumber of desired 
measurement values d, which are converted to conesponding first mathematical costs cl and 
reproduction quaUties R. Instead of hqnrtting desired measurement values d, the user 100 can 
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also input desired mathematical costs cs. During this learning stage, for each reproduction 
quality R a number of processing algorithms with corresponding output quality measures M 
is scanned When the output quality measure M corresponding to a psycho-acoustical quality 
as desired by the user 100 is reached, the user 100 can indicate this to the parameter value 
5 calculation means 346 via a learning control coimection Ic -wired or wireless. The parameter 
value calculation means 346 can then store the pair reproduction quality R and parameter 
value pv, so that during operation, the feedback is no longer needed, but rather that ftom a 
reproduction quality R corresponding to a measurement m, the correct parameter value pv 
can be sent to an audio processing unit 342. The learning control connection Ic can also be 
10 used to specify which of tiie available processing should be used for obtaining an output 
audio agnal o with the desired reproduction quality R, by setting an output selector 370. 

Another example of putting user preferences in the audio processing means 
316 is illustrated with a second user input means 361. In this example, the user 100 can 
- directly enter a second desired mathematical cost cs' and a corresponding desired processing 
15 algorithm selection na into the algorithm selector 326. 

Note that in many cases flie exact pCTceived psycho-acoustical quality, e.g. the 
exact position of a virtual sound source is not important, but only that the psycho-acoustical 
quaUty changes monotonically. This relaxes the requirements on the reproduction strategy. 
Any mapping of virtual sound source angle to mathematical cost e.g. might already be 
20 sufficient 

Many processing algorithms can be designed to create some perceptible 
psycho-acoustical quality correspondhig to a reproduction quality R characterizing a selected 
algorithm. E.g. a reproduction of bass frequencies can be changed in depaidence of the 
mathematical cost. As shown in Fig. 8, as a particular reproduction quality R or part of a 

25 reproduction quality R, a specification SPEC can be calculated reflecting the spectral content 
of the output audio signal o. One example of the specification SPEC is a frequency below 
which there is substantially no sound energy presrat, e.g. a first low frequency FLl or a 
second low frequency ¥12. E.g. if the user runs at nearly the desired speed, bass frequ^cies 
are reproduced all the way down to the first low fi:equency FLl. However if he runs to slow, 

30 he looses the bass frequencies between the first low frequency FLl and the second low 
frequency FL2. Another example of the specification SPEC is the percentage of energy in 
bass range [FLl, FL2] compared to the energy in range [FL3, FH], Any equalization strategy 
can be employed as a fimction of the cost c, e.g. the amount of trebble may be a function of 
the cost c. 
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An interesting algorithm sets the mathematical cost function by means of a 
three-dimrasional bubble 150 around the user's 100 head. If he runs too slow, the distance 
between the virtual position of his head 158 and a mark point 156 in the bubble increases, 
which leads to an increased mathematical cost c, and a decreased reproduction qimlity R. The 
reproduction quality R can also change in dependence of whether the user 1 GO is inside the 
bubble 150 or not, which gives him a training tolerance. The virtual movement of the bubble 
150 compared to the running of the user could even keep track of whether the user was 
waiting for trafific lights, this situation being identified e.g. when he pushes a button. When 
inside the bubble 150, the sound could e.g. sound as if tihte user 100 is in a particular room, by 
selecting HRTFs corresponding to that room, whereas outside the bubble 150, the sound 
sounds dull. 

The distance of a virtual sound source can also be simulated. The audio- 
processing unit 342 can e.g. simulate the distance of the virtual sound source by changing the 
amplitude of the output audio signal o and second output audio signal o2. Or reverberation 
can be added. In a room if a sound source is nearby, fliere is little reverberation, whereas if 
the sound source is far, there is a greater proportion of reverberation. Additionally or 
alternatively, virtual corridors can be generated, on which the virtual sound source reflects its 
sound. 

A nimiber of options are also possible for changing a stereo quality S of a 
stereo audio signal. E.g. an angle 1 60 b_etween a first virtual sound source 1 52 and a second 
virtual soimd source 154 can be diminished as the mathematical cost c goes up, resulting in a 
lowec stereo quality S. Or the first and second output audio signal o resp. o2 can be made 
more similar. Or there can be a hard switch fix>m stereo to mono. Under stereo signal should 
also be understood multichannel audio, and a corresponding stereo quality S is e.g. the 
number of channels. 

An example of a gradual change between stereo and mono is realized by 
calculating changed stereo signals L.'and R' according to the following equations: 

r=(l + a)|+(l-a)| 

ii=a-«)f-(i+«)f [3] 

By changing liie value of a parameter a between 0 and 1 , a change between 
mono and stereo is effected. 
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The measurement device 312 and second measurement device 3S2 can be 
anyfliing, e.g. a clock or a G.P.S. sensor indicating the position of the user 100. In particular 
it could be a biometric measurement device, such as a pace meter connected to a running 
shoe, a chest strap or ear-lobe heart rate meter 106, a thermometer, etc. These measuring 
5 devices are interesting when used for sports performance measiu:ement. The measurement 
device 3 12 could also be incorporated in a professional training apparatus, e.g. a rolling belt 
for indoors jogging. The style of running -particularly if unhealthy- could also be fed back. 

In a ^me application, a second mathematical cost c2 can be set by a cost 
determining means 3 13, e.g. a random generator. Depending on his luck, the user's 100 

10 mathematical cost is set back to the second madiCTiatical cost c2 and he has to run harder to 
re-achieve the level of the third mathematical cost c3, as determined by a second 
mathematical cost calculation unit 350 &om the second measurement device 352. 

Fig. 4 schematically shows an embodiment of the audio feedback system. An 
audio source 421 delivers an input audio signal i to a conditioning unit 402. The audio source 

15 421 can be e.g. a portable audio player or an audio distribution server in a fitness crater. A 
measurement device 412 performs a measurement m, which is converted by a mathematical 
cost calculation unit 410 to a mathematical cost c, which is also input in the conditioning unit 
402. The conditioning unit 402 contains an audio processing means 416, which are arranged 
to process the input audio signal to obtain an output signal o of a reproduction quality R 

20 dependent on the mathematical cost c, which is sent to a sound production means 414;, e.g. a 
pair of headphones or the loudspeakers of a television. The measurement device 412, 
matiiematical cost calcidation unit 410, conditioning unit 402, audio source 421, and sound 
production meaxis 414 can be realized separately or in any combinatiotL E.g., typically an 
audio reproduction apparatus may contain the conditioning unit 402, audio source 421 and 

25 mathematical cost calculation unit 410. 

A head tracker may be present, so that the positions of virtual sound sources 
are corrected for movements of the user's 100 head. Also meam may be present -e.g. a 
microphone- to pick up certain sounds from the environment and mix them with the signal 
for the sound production device 414 for improved safety. 

30 Specification of e.g. the cost function may instead of being done by the user 

100 come over a chaimel -such as e.g. internet- through an interface, JBrom a second person, 
e.g. a personal trainer. Or the specification may be done at a different time by the user 100, 
e.g. on his PC. E.g., he can make a training schedule for the whole month, which can be 
downloaded e.g. wirelessly to the audio reproduction apparatus. Parameters of functions and 
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functions may even be downloaded &om e.g. internet, and e.g. shared between users who 
want similar training sessions. Specifications made during training and stared in a memory, 
may also be downloaded through the interface to the computer for farther analysis^ e.g. 
training improvement 

5 It should be noted that the above-mentioned embodiments illustrate rather than 

limit the invention and ttiat those skiUed in the art are able to design alternatives, without 
departing firom the scope of the claims. Apart from combinations of elements of the invention 
as combined in the claims, other combinations of the elements within the scope of the 
invention as perceived by one skilled in the art are covered by the invention. Any 

10 combination of elements can be realized in a single dedicated element. Any reference sign 
between parentheses in the claim is not intended for limiting the claim. The word 
"conqwismg'* does not exclude the presence of elements or aspects not listed in a claim. The 
word "a" or "an" preceding an element does not exclude the presence of a plurality of sudi 
elements. 

15 The invention can be implemented by means of hardware or by means of 

software running on a computer, and previouidy stored on a data carrier or transmitted over a 
signal transmission sj^tem. 
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1 , An audio reproduction sq>paratus comprising: 
input means for irq>utting an input audio signal; 

an output for outputting an output audio signal derived fiom the iajput audio 

signal; 

5 _ a cost input for inputting a mathematical cost derived &om a measurement, 

which measurement is user-influenceable; and 

a conditioning unit, capable of delivering the output audio signal in . 
dependCTice of the mathematical cost, 

characterized in that the conditioning unit comprises an audio processing means arranged to 
10 process the input audio signal to derive the output audio signal with a reproduction quaUty in 
dependence of the mathematical cost 

2. An audio reproduction apparatus as claimed in claim 1 , wherein the 
reproduction quality comprises a ttiree-dimensional position of a virtual sound source, the ; 

15 audio processmg means being able to simulate the virtual sound source by means of the 
output audio signal. 

3 ^ . An audio reproduction ^paratus as claimed in claim 2, wherein the audio 

processmg means comprises a filter arranged to simulate the position of the virtual sound 
20 source by deriving the output audio signal by filtering the input audio sigoal with a user 
dependent head related transfer function. 

4, An audio reproduction apparatus as claimed in claim 2, wherein the audio 

processing means comprises an audio processmg unit arranged to simulate the position of the 
25 virtual sound soxirce by changmg a property of the output audio signal selected firom signal 
amplitude and added reverberation. 



5. An audio reproduction apparatus as claimed in claim 1, wherein the audio 

processmg means is arranged to derive a second output audio signal, together with the ou^ut 
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audio signal constituting a stereo audio signal, the audio processing means being arranged to 
derive the stereo audio signal froni the iiq)ut audio signal vdth a specified 
dependent on the mathematical cost. 

5 6. An audio reproduction apparatus as claimed in claim 1 , wherein the 

reproduction quality comprises a specification of a distribution of frequencies of the output 
audio signal. 

7. An audio reproduction apparatus as claimed in claim 1, comprising a first 
10 quality calculation unit for determining the reproduction quality for use in the subsequent 

derivation of the output audio signal by the audio processing means. 

8. An audio reproduction apparatus as claimed in claim 1, comprising qiia^ 
measuring means for measuring an output quality measure of the output audio signal, and 

15 comprising parameter value calculation means for calculating a parameter value, for use in 
the subsequent derivation of the output audio signal by the audio processing means. 

9. An audio reproduction apparatus as claimed in claim 1 , wherein a 
mathematical cost calculation unit is comprised which is arranged to derive the mathematical 

20 cost from the measurement receivable from a measurement device. 

10. An audio reproduction spparatus as claimed in claim 9, wherein the 
mathematical cost calculation unit is arranged to derive the mathematical cost based on a 
difference betvtreen the measurement and a chosen value. 

25 

1 1 . An audio reproduction ^paratus as claimed in claim 9, wherein the 
mathematical cost calculation unit is arranged to derive the mathematical cost from a 
biometric measurement. 

30 12. An audio feedback system comprising: 

an audio source; 

a measurement device arranged to deliver a measurement which is user- 

infiuenceable; 
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a mathematical cost calciilatioii mut, arranged to derive a mathCTiatical cost 

from the measurement; 

a sound production device; and 

a conditioning unit arranged to receive an input audio signal from the audio 
5 source, to receive the mathematical cost, and to deliver to the sound production device an 
output audio signal derived from the input audio signal, in dependence of the mathematical 
cost, 

characterized in that the conditioning unit con:q)rises an audio processing means airanged to 
process the iapat audio signal to derive the output audio signal with a reproduction quality in 
10 d^endenceof themalliematicalcost 

13 A method of dcaiving an output audio signal from an input audio signal in 

dependence of a mathanatical cost dacived from a measurement which is user-influenceable, 
characterized in that the output signal is derived with a specified reproduction quaHty 

1 5 dependent on the mathematical cost 

14. A computer program for execution by a processor, desaibing the method of 

claim 13. 



20 15. 



A data carrier storing the computer program of claim 14. 
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ABSTRACT: 3 0. 1?. ' * 

The audio reproduction s^jparatus comprises a cost iiq>ut for iiq>utting a 
mathematical cost derived from a measureanent, which measuremeut is user-influeaceable 
and a conditiomng unit, capable of deUvering an ou^ut audio signal in dependence of the 
mathematical cost, characterized in that the conditioning unit comprises an audio processing 
means arranged to process an input audio signal to derive the output audio signal with a 
reproduction quality in dependence of the mathematical cost As a r^roduction quaUty the 
position of a virtual sound source and the quaHty of a stereo signal are also possible. A 
system comprising the audio reproduction apparatus, a measurement device and a sound, 
production device and a method of to deriving the output audio signal with a reproduction 
quality m dependence of the mathematical cost are also presented. 
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